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[57] ABSTRACT 

An interpolation ^paratus for preventing image deteri- 
oration caused by correlation detection errors. The 
apparatus comprises a calculation means for obtaining 
the arithmetic mean of pixels on the scan lines above 
and below the line being interpolated, a correlation 
value detection means for obtaining the correlation 
value of the pixels, a setting means for outputting the 
reference value of correlation, a comparison means for 
outputting a binary signal set, a determination means for 
determining the interpolation line, and a selection 
means for selecting and passing the output of the calcu- 
lation means. 

12 Claims^ 11 Drawing Sheets 
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FIG. 2 
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FIG. 6 
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ADAPTIVE INTERPOLATION METHOD AND A2=.|^n-Oi j 

APPARATUS USING €X)RRELATION DETECnON 



BACKGROUND OF THE INVENTION 



t T?- u r u ' ^® ^^^^ ^ ^® interpolated pixel Bn is 

LField of the invention selected by determining which of these differences is 

The present invention relates to an interpolation smallest, and then applying a corresponding equation, 
method and apparatus used, for example, for generating Thus, if imn.=Al^/!= Mn-l+Oi-f l!/2 if 
a frame signal from a field signal in televisions, video min.=A2^/i=j An-hCn\/2 if min.=A3,5- 
recorders, printers, photocopiers, and similar devices n~\An-\-l-\-Cn—\l/2, 

that use gray or color scale unages in the image and data Thus, this interpolation method compares the level 
processing fields. difference of the pixel An above and the pixel Cn below 

2. Prior art the interpolated pixel Bn with the level difference of the 

Pixel density conversion technologies have become jj pixel An+ 1 right above and the pixel Cn - 1 left below, 
increasmgly unportant with the devilopment of digital and the level difference of the pixels An- 1 left above 
imaging devices. In IDTV (improved definition TV) and Cn-hl right below the interpolated pixel Bn. It is , 
and EDTV (enhanced definition TV), a single frame is assumed that the continuity, i.e., correlation, between 
generated by interlacing two fields in the broadcast the images is highest in the direction in which the pixel 
signal and video signal, and the method of non-inter- 20 level is lowest, and uses the average of the pixel values 
laced reproduction of these frame becomes very impor- m this direction as the value of the interpolated pixel, 
tant (See Shashin Kogyo (Photography industry), Oct 1989, 

This non-interlaced reproduction of firames can be pp. 107-108.) There is a related method that expands 
easily accomplished using the information firom one this concept to gray scale interpolation and expands the 
previous field when there is a correlation between the 25 direction of interpolation to the right and left of these 
frames as in still images. When there is no precise frame three directions (Japanese Patent Laid-Open No. H2- 
correlation as in a movirig image, the information from 177683). 
the previous field is the information for a point in time 3. Problem to be solved 

l/60th second earlier and cannot be used for direct field with this conventional method, however, the correla- 
mterladng. It is therefore necessary to interpolate the 30 tion determining the interpolation direction is evaluated 
data for one field between the scan lines to reproduce by comparing the absolute values of the pixel level 
one complete frame, differences in plural interpolation directions, specifi- 

The printer engine m video printers and other video cally vertically, and right and left diagonally m the 
signal hard copy printers likewise records images with above method. The highest correlation between images 
the same number of pixels as in a complete frame. If the 35 is determined to be in the direction of the lowest level 
input video signal is a still unage, the printer can print difference, and the pixel is interpolated m this direction, 
the image directly to paper, but if the signal is a moving This results in the following problems, 
image, the printer engine must mterpolate the informa- If the pixel level difference is high in all interpolation 
tion for one field to obtam the same number of pixels as directions it should be determined that there is no real 
in the full frame before printing the image. 40 correlation and linear interpolation should be applied. 

Linear interpolation using the average values of the But if there is even a slight difference in the pixel levels, 
pixels m the preceding and following scan lines has a correlation will be wrongly detected, the average of 
conventionally been used for field interpolation. Be- the pixels m this wrong interpolation direction will 
cause this interpolation method generates additional therefore be used as the interpolated value, and pixel 
pixel data from only a few pixels, the object has been to 45 noise and image deterioration will result, 
smooth the image by increasing the number of pixels Furthermore, if the pixel level difference is low m all 
rather than to unprove the resolution. The interpolated directions and there is a correlation in all dhrections, it 
image is therefore relatively defocused or blurred com- should be determined that there is a real correlation 
pared with the original source image. between the lines and linear interpolation should be 

Another interpolation method has smce been devel- 30 applied. But if there is even a slight difference in the 
oped to resolve tiiese problems with linear interpolation pixel levels, a correlation will again be wrongly de- 
by using statistical properties of the image, e.g. the tected, and pixel noise and image deterioration will 
continuity between fields in a moving image, to obtain a result 

higher vertical resolution and to obtain diagonal lines FIG. 13 is an example of an image in which interpola- 
that are smoother than m the linearly interpolated 55 tion noise will occur. The circles drawn with a solid line 
unage by using correlation detection. are input pixels, and the dotted line circles are interpo- 

This interpolation method usmg correlation detection lated pixels. Two vertical black lines are input one pixel 
is explained in fiirther below with reference to FIG. 12. apart, and pixel Bn is obtained by interpolation. The 

In FIG. 12 lines A and C are scan lines from the same minimum pixel level difference is obtained in the three 
field input continuously to the rasterizer. Line B is the 60 interpolation directions shown in the figure. The pixel 
scan line that is not input in this field and which must be level difference will be low in all three directions in this 
interpolated. If the pixel to be interpolated is pixel Bn in example, but if there is some slight variance for any 
line B where n is the pixel number, the differences (Al, reason and the level difference is lowest in either diago- 
A2, A3) in the three brightness levels passing through direction, that will be selected as the interpolation 

pixel Bn between Imes A and C are expressed by the 65 dkection. Bn will therefore be interpolated as a black 
following equations. pixel, resulting in noise. 

Furthermore, if the pixel level difference is equally 
Ai=j^B"i-Oi+i| small in both diagonal directions compared with the 
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vertical pixel level difference, Le., a contradiction exists maximum ±90 degrees to the vertical, obtaining the 

in determining the correlation from the pixel level dif- atithmetic mean of the pixel level of the two pixels 

ference, it should be determined that there is no correla- above and below on the interpolation line, and obtain- 

tion and linear interpolation in the vertical direction ing the pixel level of the pixel to be interpolated, a 

should be applied. With the conventional method, how- 5 correlation value detection means for obtaming the 

ever, one of these diagonal directions will be selected, pixel level difference of the two pixels on the interpola- 

again resulting in image deterioration. tion line and detecting the correlation value, a setting 

In general, the correlation interpolation method means for outputting two reference values, a strong and 

smoothes diagonal lines in the image and improves ver- a weak value, used to determine whether the correla- 

tical resolution if the correlation can be correctly de- 10 tion mdicated by the correlation value output by the 

tected using continuous elements in the image and the correlation value detection means exists, a comparison 
interpolation direction is correct, but noise and loss of means for comparing the magnitude of the correlation 

image quality result if the correlation is not correctly value output by the correlation value detection means 

detected. How the correlation is evaluated therefore with the two reference values, and outputting a binary 

becomes extremely important. IS signal set showing the presence of a correlation in each 

To obtain an image of quality equal to a fiill frame direction, a determination means for determining the 

signal image from a field signal requires that even nearly interpolation line using the output set of the comparison 

horizontal diagonal lines be unproved. This requires at means, and a selection means for selecting and passing 

least seven directions of interpolation. When the direc- the output of the calculation means according to the 

tion closest to the horizontal is used for interpolation, 20 output of the determination means. This method sets 

nearly horizontal diagonal lines can be improved, but plural interpolation lines passing through the pixel to be 

when the interpolation is wrong, significant noise and interpolated at an angle of a maximum ±90 degrees to 

loss of horizontal resolution result because the interpo- the vertical, sets, within the group of plural adjacent 

lated pixels are horizontally separated by six pixels. pixels on the scan lines above and below the pixel to be 

Thus, when the number of pixels used to determine the 25 interpolated, a virtual pixel between adjacent pixels 

correlation is large, higher precision correlation detec- within the range of at least one pixel on each side of the 

tion is required the closer the interpolation direction is pixels directly above and directiy below the pixel to be 

to the horizontal. interpolated, and defines the arithmetic mean of the 

Furthermore, because the angles of the interpolation pixel levels of the two adjacent pixels as the pixel level 

lines to the vertical in the conventional method are 45, 30 of the virtual pixel, and increments the angles of the 

63.4, 71.6, and 76.0 degrees, the minimum interpolation interpolation lines near the vertical in smaller steps 

angle is 45 degrees and there is high interpolation error using the virtual pixel. 

near the vertical direction. An alternative correlation detection interpolation 

cTTArfA# A n V r\T2 TTTCf Txn/Tsxmr^xT method according to the present invention intm)olates 

SUMMARY OF THE INVENTION 33 ^ ^^^^ ^^^-^^ ^^^^ ^^^^^ ^^^3^^ 

Therefore, an object of the present invention is to A(-2),A(-1), A(0), A(-l-l), A(+2), A(4-3)aboveand 
provide an interpolation apparatus that applies correla- the seven pixels C(— 3), C(— 2), C(— IX C(0), C(+l), 
tion detection, prevents image deterioration from corre- C(-f2), C(-f- 3) below where A(0) and C(0) are the pix- 
lation detection errors, and unproves interpolation per- els directly above and directly below pixel B(0), respec- 
fonnance near the vertical and horizontal directions. 40 tively, by grouping the pixel pairs A(— 3) and C(3), 

To achieve the above objective, a correlation detec- A(-2) and C(2), A(-l) and C(l), A(0), A(l) and 
tion interpolation apparatus according to the present C(-l), A(2) and C(-2), and A(3) and C(-3) on the 
invention comprises a calculation means for setting seven interpolation lines passing through pixel 6(0) into 
pliu-al interpolation lines passmg through the pixel to be a first region of the three interpolation lines A(— 1) and 
interpolated at an angle of a maximum ±90 degrees to 45 C(l), A(0) and C(0), A(l) and C(- 1), a second region 
the vertical, obtaining the arithmetic mean of the pixel of the three interpolation lines A(l) and C(— 1), A(2) 
level of the two pixels above and below on the interpo- and C(— 2), and A(3) and C(— 3), and a third region of 
lation line, and obtaining the pixel level of the pixel to the three interpolation lines A(— 3) and C(3), A(— 2) 
be interpolated, a correlation value detection means for and C(2), A(— 1) and C(l). 

obtaiidng the pixel level difference of the two pixels on 50 In this method the interpolated value of the pixel B(0) 
the interpolation line and detecting the correlation is detennmed by applying d step for comparing tiie 
value, a setting means for outputting a reference value difference in the two pixel levels of each interpolation 
used to determine whether the correlation indicated by line in the first region with a predetermined reference 
the correlation value output by the correlation value value to detect the existence of a correlation, a step for 
detection means exists, a comparison means for compar- 55 similarly detecting the existence of a correlation in the 
ing the magnitude of the correlation value output by the three interpolation lines of the second region when 
correlation value detection means with the reference there is a correlation in the left descending direction 
value, and outputting a bmary signal set showing the (A(l)-^(— 1)) in the first region, and defining the 
presence of a correlation in each direction, a determina- aritlunetic means of the two pixel levels as the value of 
tion means for determining the interpolation line using 60 B(0) for the correlationdetected interpolation hues, and 
the output set of the comparison means, and a selection defhiing the arithmetic mean of the pixel level in the 
means for selecting and passmg the output of the calcu- du-ection A(1)-^C(— 1) as the value of B(0) when there 
lation means according to the output of the determina- is a contradiction in correlation detection, a step for 
tion means. similarly detecting the existence of a correlation in the 

The correlation detection interpolation method ac- 65 three interpolation lines of the third region when there 
cording to the present invention comprises a calculation is a correlation in the right descending direction 
means for setting plural interpolation Imes passing (A(-1)-*<:(1)) in the first region, and defming the 
through the pixel to be interpolated at an angle of a arithmetic mean of the two pixel levels as the value of 
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B(0) for the correlation-detected interpolation lines, and reference value in the second and third region compari- 

defining the arithmetic mean of the pixel level in the sons. 

direction A(- as the value of B(0) when there a TTnM 

is a contradiction in correlation detection, and a step for OPERATION 

defining the arithmetic mean of the pixel level in the 5 The pixel level difference of the pixels of the scan 

direction A(O)->C(0) as the value of B(0) when any lines above and below the line ofthe pixel to be interpo- 

finding other than the above is detected in the first lated is detected for each of the plural interpolation 

region. lines of different angles. The absolute value of the pixel 

An alternative correlation detection interpolation level difference for each interpolation line is compared 

apparatus according to the present invention defines the l^ reference value output by the setting means 

pixel to be interpolated as B(0), uses the seven pixels digitized. The determination means determines the 

A(-3), A(-2), A(-l), A(0), A(-l-l), A(+2), A(H-3) t^est interpolation line from tiie combination of binary 

above and the seven pixels C(— 3)> C(— 2), C(— 1), C(0), outputs for the plural mterpolation lines, and the aver- 

C(-|-l), C(-|-2), C(-f 3) below where A(0) and C(0) are value of the pixels on the scan Unes above and 

the pixels directiy above and directiy below pixel B(0), l^ below the interpolation pixel line obtained by the calcu- 

respectively, groups the pixel pairs A(— 3) and C(3), lation means for the selected interpolation line is output 

A(-2) and C(2), A(- 1) and 0(1), A(0) and C(0), A(l) ^s the interpolated value. 

and C(- 1), A(2) and C(-2), and A(3) and €(-3) on Alternatively, the absolute values are compared with 

the seven interpolation hnes passing through pixel B(0) strong/weak reference values and digitized, the 

into a first region of the three interpolation lines A(" 1) ^ interpolation hne is determined from the combina- 

and C(l), A(0) and C(0), A(l) and C(-l), a second of binary outputs for tiie plural interpolation lines, 

region of the tiuee interpolation lines A(l) and C(- 1), *® average value of the pixeU on the above and 

A(2) and C(-2), and A(3) and C(-3), and a tiiird re- obtained by tiie calculation means for 

gion of the three interpolation lines A(-3) and C(3), J^ie selected mterpolation hne is output as tiie interpo- 

A(-2) and Q2), A(-l) and C(l). The interpolated ^^^^^Jr*"^* u ^ . - , . . 

value of tiie pixel B(0) is determined by means of a Furthermore based on tiie correlation value from tiie 

calculation means for obtaming tiie aritiunetic mean of value detection nieans, the comparison 

two pixel levels for each of tiie seven different mteipo- P'f^ ^^"^^f^ tiic existence of a corrdation for each 

lation lines to obtain tiie pixel level of tiie pixel to be 12^^>^f t^^n hne m tiie first, second, and tiurd regions^ 

interpolated B(0), a correlation value detection means The determination m^^s determines tiie direction of 

for obtaining tiie pixel level difference of tiie two pixels ^^ "^^rpolation lme based on tiic correlation m tiie 

on each of tiie seven interpolation Unes and dete^cting ^^ShLS^ t "^"^^^T. f 

tiie correlation value, a seLgmean^ '^^^l.tT^^^^^^ 

tn'n^^fj^^^^ 35 tionintiietiiirdreSwhentiifireisacorrelaSoS^ 
tion indicated by tiie correlation value output by tiie ^ght descending ejection in tiie first region, and deter- 
correlation value detection means exists a comparison tiie diS>n of tiie mterpolation iSeb^oX 
means for comparing tiie magmtude of tiie correlation correlation in tiie first regiok when tiie ^datSn 
va^ue output by tiie correlation va^ue detection means therein is neitiier of tiie pfevious two. ThrSon 
with tiie reference v^uem each outputs^ interpolated vaS fr^ 
Jrdregions,^doutputdngabmary ^^^^ calculated value for e^ interpolation line 
tiie presence of a correlation m e^h direction for each ^^^^^ fr^m tiie calculation means based onTe output of 
region, a aeiennmauon means tor determimng the mter- the determination means, 
polation direction usmg the output set of the compari- 
son means, and a selection means for selecting and pass- 45 BRIEF DESCRIPTION OF THE DRAWINGS 
*^!i^f o^tP^t of tiie calculation means according to tiie jhe present invention wiU become more fully under- 
output of tiie det^mmationmeam stood from tiie detailed description given below and tiie 
The determmation means m tius embodiment com- accompanying diagrams wherein: 

third dea)ding circuits for de- piG. 1 is a block diagram of a correction detection 

codmg tiie bmary signals for the first, second, and tinrd 50 mterpolation apparatus according to a first embodiment 

regions and controUmg tiie selection means. When the of the invention 

bumry signal sho^ys a correlation m tiie A(l)-^(- 1) FIG. 2 is a conceptual diagram of tiie interpolation 
(left descen<hng) interpolation hne. tiie output of tiie metiiod used to describe the operation of tiie first em- 
second decodmg arcmt is given precedence over the bodiment, 

output of tiie first decoding ckcuit When tiie binary 55 FIG. 3 is a chart used to describe tiie correlation 

signal shows a correlation m tiie A(" 1) -^(1) (right detection operation of tiie first embodhnent, 

descaidmg) interpolation hne, tiie output of tiie tiiird FIG. 4 is a detailed circuit diagram of tiie determina- 

dec^hng cuxmt is given precedence over tiie output of tion means and tiie selection means of tiie correlation 

tiie first decoding cffcmt When tiie binary signal shows detection interpolation apparatus accordmg to tiie first 

any relationship other than one of the above two, the 60 embodiment, 

output of tiie first decoding circuit is given precedence. FIG, 5 is a block diagram of a correlation detection 

The output of the selection means is determined by mterpolation apparatus according to a second embodi- 

which of the first, second, and third decoding circuits ment of the invention, 

has precedence. FIG. 6 is a chart used to describe tiie correlation 

In a further alternative of tiie above embodhnent, tiie 65 detection operation of tiie second embodiment of tiie 

settmg means outputs a strong/weak reference value, mvention, 

and tiie comparison means uses the weak reference FIG. 7 is a detailed circuit diagram of tiie determina- 

value in the first region comparison, and the strong tion means and the selection means of the correlation 
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detection interpolation apparatus according to the sec- decoder 121 is a 3-bit ii^>ut, negative logic binary de- 

ond embodiment of the invention, coder 121 (74LS138) to which input C is the most-sig- 

FIG, 8 is a block diagram of a correlation detection nificant bit (MSB) and input A is the least-significant bit 

interpolation apparatus according to a third embodi- (LS6). 

ment of the invention, 5 The selection means 10 comprises five analog 

FIG. 9 is a conceptual diagram showing the positions switches lOOA-lOOE, the outputs of which form a 

of the pixel data and the pixel information on the input wired OR connection. 

lines A and C relative to the pixel to be interpolated The binary decoder 121 and NOR gate 122 together 
B(0), the seven interpolation lines and interpolation form a determination means 12 with the decoding char- 
values (H in the figure), 10 acteristics shown in Table 1. The selection means 10 is 

FIG. 10 is a chart used to describe the correlation constructed using the five analog switches lOOA-lOOE. 

detection operation of the third embodiment of the The operation of the correlation detection interpola- 

invention, tion apparatus thus comprised is described below with 

FIG. 11 is a detailed circuit diagram of the determina- reference to the accompanying figures, 

tion means and the selection means of the correlation IS FIG. 2 shows the relationship between input pixel 

detection interpolation apparatus according to the third data on lines A and C and the pixel data on the interpo- 

embodiment of the invention, lated line B to illustrate the principle of the interpola- 

FIG. 12 is an illustration used to describe the conven- tion operation, 

tional interpolation method with correlation detection, The image data input from the image input terminal 

and 20 18 is converted by the horizontal delay means 2A and 

FIG. 13 is an illustration of an image with which the 2B to the data for the three pixels C(— 1), C(0), and 

conventional interpolation method results in interpola- C(-|- 1) on line C The data for the three pixels A(— 1), 

tion noise. A(0), and A(-f 1) on line A is similarly converted by the 

DESCRIFTION OF PREFERRED ^^J^"^ f^^^ 6 and the horizontal delay means 

EMBODIMENTS ^ 

The interpolation method is described first 

FIG. 1 is a block diagram of a first embodunent of a The calculation means 4A computes the arithmetic 
correlation detection interpolation apparatus according mean for pixel A(— 1) on line A and pixel C(l) on Ime 
to the present invention. As shown m FIG. 1, this appa- C, and obtains the mterpolation value H(— 1) for the 
ratus comprises horizontal delay means lA, IB, 2A, and 30 right descending, 45 degree interpolation direction in 
2B for introducmg a one pixel delay to sequentially shift FIG. 2. Similarly, the calculation means 4B computes 
the pixel data on the scan Imes (lines A and C) used for the mterpolation value H(0) for the vertical mterpola- 
interpolation, and horizontal delay means 3A-3E to tion direction, and calculation means 4C computes the 
introduce a one pixel delay for adjustment to the posi- interpolation value H(l) for the 45 degrees left descend- 
tion of the pixel to be interpolated. 35 ing interpolation direction. The calculation means 4D 

The calculation means 4A-4C compute the arithme- fiirther computes the 26.6 degrees right descending 
tic means of the pixels on lines A and C The calculation interpolation value H(— 0.5) by obtaining the arithmetic 
means 4D computes the arithmetic mean of the outputs mean of the outputs from calculation means 4A and 4B, 
from calculation means 4A and 4B, and calculation and calculation means 4E computes the 26.6 degrees left 
means 4E computes the arithmetic mean of the outputs 40 descending inter[)olation value H(0.5). 
from calculation means 4B and 4C. Which of these five interpolation values should be 

The substraction means 5A-5G subtract the level of used is determined by the process described below, 
the line C pixel from that of the Ime A pixel to compute selected by the selection means 10, and output from the 
the pixel level difference in each direction and detect mterpolation output terminal 19, 
the correlation value. 45 The operation applied for correlation detection is 

The vertical delay means 6 delays line A by one scan described next 
line period to adjust the timing so that Ime A is output The subtraction means 5A obtains the difference of 
simultaneously to line C pixel A(— 1) on line A and pixel C(l) on hne C to comr 

The absolute value comparison means 7A-7C are pute the pixel level difference in the 45 degrees right 
bmary conversion devices that compare the absolute 50 descending direction. Similarly, the subtraction means 
value of the inputs from the subtraction means 5A-5C 5B and 5C obtain the pixel level differences in the verti- 
with a predetermined setting kO and output a value of 1 cal and 45 degrees left descending directions, 
if the absolute value is greater than the predetermined The setting means 8 determines the reference value 
value, and a value of 0 if the absolute vdue is smaller, kO used by the absolute value comparison means 7A-7C 

The output of the subtraction means 5A-5C is input 55 to evaluate the existence of a correlation in each of the 
to the settmg means 8. The setting means 8 determines mterpolation dhections, and in the present embodiment 
the predetermined value kO based on the input value, determines the reference value kO according to the 
and outputs the result to the absolute value comparison value of the subtraction means 5A-5C output. The ref- 
means 7A-7C. erence value kO is detenmned by obtaimng the average 

The determination means 12 determines the best in- 60 of the three absolute values of the outputs from the 
terpolation line based on the binary signal set output by subtraction means 5A-5C and setting the reference 
the absolute value comparison means 7A-7C, and the value kO according to this average. Specifically, the 
selection means 10 selects and outputs one of tiie plural reference value is set to one-half the arithmetic mean as 
inputs based on tiie selection signal. a result of experiments with various different unages. 

FIG. 4 is a detailed circuit diagram of the determma- 65 The output of the subtraction means 5A-5C is con- 
tion means 12 and selection means 10 shown m FIG. 1. verted to a positive value by the absolute value opera- 

The determination means 12 comprises a binary de- tion of the absolute value comparison means 7A-7C and 
coder 121 and a four input NOR gates 122. The bmary compared with the reference value kO output by tiie 
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setting means 8, being converted in the process to a 1-bit three directions, and linear interpolation is applied in 
binary value D(— 1), D(0), or D(l) expressing whether that direction. 

the subtraction means 5A-5C value is less than (1) or Thus, the present invention offers the following bene- 
gr eater than (0) the reference value kO. fits when compared with the conventional method 

Table 1 is the true logic table showing the character- 5 whereby the pixel level differences in each direction are 
istics of the determination means 12 according to the compared with each other because correlation detec- 
present embodiment. tion is based on the reference value kO. 

TABLE 1 ^- Detection errors can be prevented because an ac- 

curate evaluation of the correlation direction, of no 
correlation, and of correlations in all directions is possi- 
ble. 

2. Detection errors can be prevented because contra- 
dictions in the correlation can be detected. 

3. Correlations can be evaluated in five directions, 
and interpolation performance at angles less than 45 
degrees to the vertical is improved. 

Therefore, diagonal lines m an image can be 
-m. r: * V • * i_i i. xi_ i /rx/ ^\ smoothcd, and the vertical resolution can be improved 

rJ^^^^^^n'l^-^^^ Tf^r'^'^.^^r^i for pixds interpolated iB a diagonal direction due to a 
p(0). D(1))=(0. 0, 0) mdKat« tot die pixel level dif- 20 correMon. 
ference exceeds the predetermmed reference value kO m 

each of the three interpolation directions, and that there Second embodiment 

is therefore no significant correlation. Therefore to ai^.^*^ ^ r^x. ^- ^. 

prevent noise, the vertical interpolation direction H(0) ^ An alternative embodnne^^ 

is selected and linear interpolation is appUed. 25 ^^""^^^ herembekDw with r^erence to the accompa- 

Similarly,at(l, 1, 1), there is a correction in all direc- ^ymg figures As shown m FIG 5. tk^ 
tions and no specific directional characteristic can be f'^l horizontal deky means lA, IB, 2A, and 2B for 
determined. The vertical interpolation direction H(0) is "^^ducmg a one pixel delay to sequentiaUy shift the 
therefore selected agam and linear mterpolation is ap- P"^^ hnes (hues A and C) used for 

plig^ 3Q mterpolation, and horizontal delay means 3A-3E to 

Because an interpolation line with a clear correlation introduce a one pixel delay for adjustment to the posi- 
can be determined when the values are (0, 0, 1), (0, 1, 0), mterpolated. 
and (1. 0, 0), the corresponding directions H(l), H(0), calculation means 4A-4C compute the arithme- 

and H(— 1) are selected. means of the pixels on hnes A and C The calculation 

When a correlation is confirmed m two directions (0, 35 computes the arithmetic mean of the outputs 

1, 1) and (1, 1, 0), the true correlation can be determined calculation means 4A and 4B, and calculation 

to exist between these directions, and the values H(0.5) means 4E computes the arithmetic mean of the outputs 
and H(— 0.5) are selected as the interpolation dkection. ^^^^ calculation means 4B and 4C. 

Likewise, when a correlation is confirmed in two subtraction means 5A-5C subtract the level of 

diagonal directions but not in the vertical direction and 40 ^® ^® ^ P^^^ ^^m that of the line A pixel to compute 
there is therefore a contradiction in the evaluation of pviel level difference in each direction and detect 

correlation (1, 0. 1), there is assumed to be an error m correlation value. 

the correlation detection and H(0) is selected as though The vertical delay means 6 delays line A by one scan 
there were no correlation. liae period to adjust the timing so that line A is output 

FIG. 3 is a map of the characteristics shown in Table 45 simultaneously to Ime C. 
1, and shows the direction of the interpolation Ime out- The absolute value comparison means 7A-7C are 
put according to the combination of the values D(— 1), binary conversion devices that compare the absolute 
D(0), and D(l). value of the inputs firom the subtraction means 5A-5C 

llie binary decoder 91 binary decodes the 3-bit input, ^th a predetermined setting kO and output a value of I 
and separates the obtained states by case according to 50 i^ the absolute value is greater than the predetermined 
Table I. For example, if the input is (1,0,0), the buffer value, and a value of 0 if the absolute value is smaller, 
gate lOOA becomes active, and interpolated signal Similarly, absolute value comparison means 7D-7F 
C(— 1) is output to the interpolation output terminal 19. compare the absolute value of the inputs from the sub- 
If the case is a vertical correlation (0, 1,0), no correlation traction means 5A-5C with a predetermined setting kl. 
(0,0,0), correlation in all directions (1,1,1), or a contra- 55 The setting means 8A and 8B determine the predeter- 
dictory correlation (1,0,1), buffer gate lOOC is activated mined values kO and kl, and output the results to the 
using the negative logic OR gate 92, and the interpo- absolute value comparison means 7A-7C and 7D-7F, 
lated signal C(0) is output to the interpolation output respectively. 

terminal 19. The determination means 11 determines the best m- 

To summarize, data for six pixels on the scan lines 60 terpolation line based on the binary signal set output by 
above and below the pixel to be interpolated is used to the absolute value comparison means 7A-7C and 
detect the pixel level difference for interpolation lines in 7D-7F, and the selection means 10 selects and outputs 
three directions intersecting the interpolation pixel. one of the plural inputs based on the selection signal. 
These pixel level differences are compared with a dy- The operation of the correlation detection interpola- 
namically generated reference value kO and the result is 63 tion apparatus thus comprised is described below with 
binarized. The best inteipolation line is determined reference to the accompanying figures, 
from among five interpolation directions using the com- The following description concerns primarily the 
binations of binary outputs to the interpokition lines in correlation detection operation of the present embodi- 
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ment because the interpolation operation is the same as When a correlation is confiutned in two directions (0, 

that of the first embodiment. 1, 1) and (1, 1, 0), the true correlation can be determined 

The subtraction means 5A obtains the difference of to exist between these directions, and the values H(0.5) 

pixel A(— 1) on line A and pixd C(l) on line C to com- and H(— 0.5) are selected as the interpolation direction, 

pute the pixel level difference in the 45 degrees right 5 Likewise, when a correlation is confirmed in two 

descending direction. Similarly, the subtraction means diagonal directions but not in the vertical direction and 

5B and 5C obtain the pixel level differences in the verti- there is therefore a contradiction in the evaluation of 

cal and 45 degrees left descending directions. correlation (1, 0, 1), there is assumed to be an error in 

The output of the subtraction means 5A-5C is con- the correlation detection and H(0) is selected as though 
verted to a positive value by the absolute value opera- 10 there were no correlation. 

tion of the absolute value comparison means 7A-.7C and Furthermore, at (1. 1, I), there is a correlation in aU 

7D-7F, and compared with the reference values kO and directions and no specific directional characteristic can 

kl output by the setting means 8A and 8B. In the pro- ^e determined. The vertical interpolation direction H(0) 

cess the values are converted to 1-bit binary values therefore selected again. 

D(- l). D(0) and D(l) and E(-l). E(0) and E(l) ex- 15 ^ y ^ contrast bmary image such as text and 
pressing whether the subtracdon mea^ 5A-5C value ^ ^^.^ ^ ^ difference in the levels of the 
less dmn (1) or greater than (0) the reference values kO ^^^^^ ^^^^ the pixel to be interpolated. Thus, when 
^CT^*^. u ^ c^u r*i. • * P"^^ levels are expressed on a 256-step scale, no 
FIG^6isachartof the case separation of the mterpo- ^^elation will be det^ted unless correlations are de- 
lation direction Imes output accordmg to the combma- 20 .^.^^ ^ .^lo*;,,^!,, Ii,.^ ^ 
tion of the values D(^ 1). D(0), D(l) and E(- 1), E(0), A 

E(l) obtained with the two reference values. ^ . J[ „ , ^ ^ , . - ^ 

TTie first evaluation is the same as that described in ^ "nages witti contmuous tones such as m a photo- 

the first embodiment above. of natural scenery, a much lower threshold value 

The first line in the table where the values (D(-l), 25 kO< = ^6 is required for accurate correlation detec- 

D(0), D(1))=(0. 0. 0) indicates that the pixel level dif. ^ ^ ^ ... 

ference exceeds the predetermined reference value kO in practice, however, many images are a combination 

each of the three interpolation directions, and that there ™se two types of images or somewhere m between 

is therefore no significant correlation. Therefore to two types. 

prevent noise, the vertical interpolation direction H(0) 30 ^® present embodiment uses a rough threshold 

is selected and linear interpolation is appHed. C^^) ^ ^® correlation detection step to detect 

Because an interpolation line with a clear correlation correlations m the high contrast parts of the image, and 

canbedetermined when the values are (0,0, 1), (0, 1,0), assumes that there is a correlation in all directions in 

and (1, 0, 0), the corresponding directions H(l), H(0), ^^^^ P^ image where there are contmuous 

and H(— 1) are selected. 35 todies. In the second correlation detection step, there- 

When a correlation is confirmed in two directions (0, ^^^^^ correlation detection is applied usmg a more re- 

1, 1) and (1, 1, 0), the true correlation can be determined strictive threshold value to those parts determined to 

to exist between these directions, and the values H(0.5) ^ correlation in all directions in the first step to 

and H(— 0.5) are selected as the interpolation direction. enable effective correlation detection for all parts of the 

Likewise, when a correlation is confirmed in two 40 "^age. 

diagonal directions but not in the vertical direction and P^^* ^ ^ * detailed circuit diagram of the determina- 

there is therefore a contradiction in the evaluation of ^^n means 11 and selection means 10 shown in FIG. 5 

correlation (1, 0, 1), there is assumed to be an error in to achieve the characteristics described using FIG. 6. 

the correlation detection and H(0) is selected as though The determination means 11 comprises two binary 

there were no correlation. 45 decoders llOA and HOB, two OR gates 111 and 11^ 

In the previous embodiment the vertical interpolation and an 8-input, 4-output multiplexer 113. TTie binary 

direction H(0) is selected and linear interpolation is decoders llOA and HOB are 3-bit input binary decod- 

again applied at (1, 1, 1) because there is a correlation in ers. The eight outputs become active when the 3-bit 

all directions and no specific directional characteristic combination of values indicated to the right of the sym- 

can be determined. In the present embodiment, how- 50 ^ols (D and E) for the inputs correspond to the values 

ever, this case causes the absolute value comparison indicated for the outputs. 

means 7D-7F to look for a correlation using a second The selection means 10 comprises five analog 

predetermined reference value kl to look for a signifi- switches lOOA-lOOE, the outputs of which form a 

cant correlation when there is a correlation in all direc- wired OR connection. 

tions (1, 1, 1) resulting from the first correlation detec- 55 The multiplexer 113 comprises four units which se- 

tion operation. The binary data pairs {E(— 1), E(0), lect and output one of the inputs a or b. Input a is se- 

E(l)) output by these absolute value comparison means lected when the selector signal input from the left m the 

7D-7F are then similarly separated into cases to deter- figure is not active, and input b is selected when it is 

mine the interpolation direction. active. 

When the relationship between the second reference 60 The bmary decoder llOA performs binary decoding 
value kl and the first reference value kO is kl <kO. the of the binary data pairs (D(— 1), D(0), D(l)) using a 
data paks (E(-l), E(0), E(l)) are again separated into relatively high reference value kO, and the bmary de- 
eight cases because the determination of a correlation coder HOB performs binary decoding of the binary data 
with reference value kl is more difficult. pairs (E(- 1), E(0), E(I)) using a relatively low refer- 

An interpolation line with a clear correlation can be 65 ence value kl. Thus when the decoded output (1,1,1) 

detenmned when the values are (0, 0, 1), (0, 1, 0), and (1, for the bmary decoder llOA is active, the inputs to the 

0, 0). and the corresponding directions H(l), H(0), and multiplexer 113 connected to the decoded output (1,1,1) 

H(- 1) are therefore selected. are switched to input b. 
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Therefore^ when the decoded output for the and the number of interpolation directions increased. In 

binary decoder llOA is not active, the outputs of the addition, the interpolation direction passing between 
binary decoder llOA and the OR gate 111 are input to the pixels may be omitted, and the number of pixels on 
the selection means 10, and the interpolation value for the above and below scan lines and the interpolation 
the corresponding* interpolation line is output from the 5 directions matched. 

image output terminal 19. When the decoded output Furthermore, the reference values kO and kl are con- 
(1,1.1) for the binary decoder llOA is active, the inter- stants in this embodiment, but they may also be varied 
polation direction determined by the binary decoder according to the pixel level difiference in three direc- 
llOB and the OR gate 112 is applied to the selection tions as in the first embodiment In this case the arithme- 
means 10, and the interpolation value for the corre- 10 tic mean of the absolute value of the pixel level difFer- 
sponding interpolation line is output from the image ence in three directions may be defined as kO, and one- 
output terminal 19. fourth of the arithmetic mean as reference value kl. 

For example, when (D(- 1), D(0), D(l)) is (1,0,0), the Furthermore, by defining kl >kO in the second em- 
binary decoder llOA output (1,0,0) is active and the bodiment, the order of separation for binary images and 
output (1,1,1) is not active. The ou^ut (1,0,0) is there- 15 natural images by case may be reversed, and the case 
fore output through the multiplexer 113, activating the (D(- 1), D(0). D(1))=(0,0,0) may be further separated 
analog switch lOOA and the interpolated signal C(— 1) into other cases using the value kl to achieve the same 
is output to the interpolation output terminal 19. result. 

When the binary decoder llOA output is (1,1,1) be- 
cause this rough first step correlation detection process 20 Tbkd embodiment 
determines a correlation in all directions and cannot FIG. 8 is a block diagram of a third embodiment of a 
determine a single specific correlation with (D(— 1), correlation detection interpolation apparatus according 
D(0), D(l)), the multiplexer 113 is caused to select input to the present invention. As shown in FIG. 8, this appa- 
terminals b to select the interpolation direction using ratus comprises horizontal delay means lA-lF for in- 
the more restrictive correlation detection enabled with 25 troducing a one pixel delay to sequentially shift the 
(E(- 1), E(0), E(l)). pixel data on the scan line (line A) above the line of the 

To summarize, data for six pixels on the scan lines pixel to be interpolated. Horizontal delay means 2A-2F 
above and below the pixel to be interpolated is used to introduce a one pixel delay to sequentially shift the pixel 
detect the pixd level difference for interpolation lines in data on the scan line (line C) below the line of the pixel 
three directions intersecting the interpolation pixel. 30 to be interpolated. Horizontal delay means 3A-3G in- 
These pixel level differences are compared with a rough troduce a three pixel delay for adjustment to the posi- 
referencc value kO and the result is binarized. The best tion of the pixel to be interpolated, 
interpolation line is determined from among five inter- The calculation means 4A-4G compute the arithme- 
polation directions using the combinations of binary tic mean of the pixels on lines A and C. 
outputs to the interpolation hnes in three directions, and 35 The subtraction means 5A-5G subtract the level of 
linear mterpolation is applied in that direction. How- the line C pixel from that of the line A pixel to compute 
ever, because a significant directional characteristic the pixel level difference in each direction and detect 
cannot be determined when a correlation is determined the correlation value. 

in all three directions using this rough reference value The vertical delay means 6 delays line A by one scan 
kO, the absolute value of the pixel level differences for 40 line period to adjust the timing so that line A is output 
these three directions is binarized using a more restric- simultaneously to line C. 

tive reference value kl, the best interpolation line is The absolute value comparison means 7A and 7C are 
determined from among five interpolation directions binary conversion devices that compare the absolute 
using the combinations of binary outputs to the interpo- value of the inputs from the subtraction means 5A-5C 
lation lines in three directions, and linear interpolation is 45 and 5E-5G, respectively, with a predetermined setting 
applied in that direction. kl and output a value of 1 if the absolute value is greater 

The present embodiment effectively applies loose than the predetermined value, and a value of 0 if the 
correlation detection with a high threshold value to absolute value is smaller. The absolute value compari- 
high contrast binary images such as text and charts, and son means 7B compares the absolute value of the inputs 
effectively detects the interpolation direction through a 50 from the subtraction means 5C-5E with a predeter- 
more restrictive correlation detection process using a mined settmg kO, and outputs a value of 1 if the absolute 
low threshold value for images with continuous tone value is greater than the predetermined value, and a 
areas such as a pictures of natural scenery, and can value of 0 if the absolute value is smaller, 
therefore effectively detect correlations in all images. The setting means 8A determines the predetermined 

In addition to the benefits of the first embodiment, the 55 value kO, and outputs the result to the absolute value 
present embodiment can actively determine the interpo- comparison means 7B. 

lation direction in images using two high/low reference The setting means 8B determines the predetermined 
values. Thus, the present embodiment offers the same value kl, and outputs the result to the absolute value 
improvement in detection error reduction as the fhst comparison means 7A and 7C. 
embodiment while further improving correlation inter- 60 The determination means 9 determines the best inter- 
polation. It can therefore smoothly interpolate diagonal polation line based on the binary signal set, and the 
edges in more images, and can unprove the vertical selection means 10 selects and outputs one of the plural 
resolution of pixels interpolated in a diagonal direction inputs based on the selection signal, 
due to a diagonal correlation. The determination means 9 comprises three 3-bit 

It is to be noted that the above embodiments were 65 binary decoders 91, 92, and S>3, OR gates 94A-94E, and 
described using three pixels on the above and below two-input AND gates 95A-95F. 
scan lines and five interpolation directions, but these The eight outputs of the binary decodera 91, 92, and 
may be increased to five pixels each or seven pixels each 93 becomes active when the 3-bit combination of values 
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indicated to the right of the symbols (D and E) for the interpolation lines in FIG. 9, Subtraction means 5D 
inputs correspond to the values indicated for the out- computes the pixel level difference for the vertical in- 
puts, terpolation line. Subtraction means 5E, 5F and 5G ob- 

The OR gates 94A, 94B, 94Q 94D, and 94E have 6, tain the pixel level differences for the 18 degrees, 27 

4, 3, 3, and 4 inputs, respectively. 5 degrees and 45 degrees left descending interpolation 

The selection means 10 comprises seven analog lines. The seven pixel level differences are divided into 

switches lOOA-lOOG, the outputs of which fonn a three groups 5A-5C 5C-5E, and 5E-5G, which are 

wired OR connection. respectively input to the absolute value comparison 

The AND gates 95A-95C apply the evaluation result means 7A-7C. 
returned by ^e decoder 93 and the OR gates 94D and 10 The output of the subtraction means 5C-5E is con- 
94E to the selection means 10 only when the binary verted to a positive value by the absolute value opera- 
decoder 91 outputs (1,0,0). AND gates 95D-95F apply tion of the absolute value comparison means 7B and 
the evaluation result returned by the decoder 92 and the con^>ared with the reference value kO output by the 
OR gates 94B and 94C to the selection means 10 only setting means 8 A, being converted in the process to a 
when the binary decoder 91 outputs (0,0,1). When the 15 1-bit binary value D(-l). D(0), or D(l) expressing 
decoder outputs any other value, the evaluation result whether the difference is less tiian (1) or greater than (0) 
returned by the decoder 91 and the OR gates 94A is the reference value kO. This bmary signal (D(-l), D(0), 
applied to the selection means lO. The output of the D(l)) states whether there is a correlation between the 
determination means 9 is apphed to the corresponding three interpolation lines of six pixels at the middle of 
analog switch lOOA-lOOG in the selection means 10, 20 FIG. 9. 

and the interpolation value for the corresponding inter- The output of the subtraction means 5A-5C is con- 
polation line is output from the interpolation output verted to a positive value by the absolute value opera- 
terminal, tion of the absolute value comparison means 7B and 

The operation of the correlation detection interpola- compared with the reference value kl (where kl <kO) 
tion apparatus thus comprised is described below with 25 output by the setting means 8B, being similarly con- 
reference to the accompanying figures. verted in the process to a 1-bit bmary value E(-3), 

The image data input from the image mput terminal E(-2), or E(-l). This binary signal (E(-3). E(-2), 

in FIG. 8 is converted by the horizontal delay means E(— 1)) states whether there is a correlation between 

2A-2F to the seven pixel data series C(- 3), C(-2), the three mterpolation lines for the six pixels A(-3), 

C(-l),C(0),C(+l).C(-h2),C(-h3)onlineC.Thedata 30 A(-2),A(-1). C(l). C(2), C(3) m FIG. 9. 

for the seven pixels A(-3), A(-2), A(-l), A(0), The output of the subtraction means 5E-5G is con- 

A(-h 1), A(-h 2), A(H- 3) on line A is similarly converted verted to a positive value by the absolute value opera- 

by the vertical delay means 6 and the horizontal delay tion of the absolute value comparison means 7C and 

means lA-lF. compared with the reference value kl output by the 

FIG. 9 shows the positions of the pixel data and the 35 setting means 8B, being similarly converted in the pro- 
pixel information on the input hues A and C (indicated cess to the binary signal E(l), E(2), or E(3), This binary 
as A and C in the figm-e) relative to the pixel to be signal (E(l), E(2), E(3)) states whether there is a corre- 
interpolated B(0) (indicated as B in the figure). The lation between tiie tiiree interpolation lines for the six 
seven mterpolation lines and values (H in the figure) are pixels A(3), A(2), A(l), C(-3), <^-2). C(- 1) in FIG. 
shown to illustrate the interpolation operation of this 40 9. 

embodiment. The determination means 9 determines which of the 

The pixel data on lines A and C is input to the calcula- interpolation values H(- 3)-H(3) is best based on the 

tion means 4A-4G in FIG. 8. The calculation means bmary signal sets (D(— 1), D(0), D(l)), (E(l), E(2), 

4A-4G compute the arithmetic mean of the pixels on E(3)), and (E(— 3), E(— 2), E(-l)). 

each of the seven interpolation Unes passing through the 45 FIG. 10 is a chart showmg the characteristics of the 

pixel to be interpolated B(0) to obtain the interpolation determination means 9, specifically showing the cases 

value for each line. Calculation means 4A, 4B, and 4C for determining the interpolation direction from the 

compute the interpolation values H(-3), H{-2). and binary signal (D(-l), D(0), D(l)) in tiie first region 

H(- 1), respectively, for the 18 degrees, 27 degrees and obtained with reference value kO, and the binary signab 

45 degrees right descending mterpolation Imes in FIG. 50 (E(l), E(2), E(3)) for the second region and (E(-3), 

9. The calculation means 4D computes the interpolation £(-2), E(-l)) third region obtained witii reference 

value H(0) for the vertical interpolation direction. Cal- value kl. The codes <number> mdicate the interpola- 

culation means 4E, 4F, and 4G compute the interpola- tion direction. 

tion values H(3), H(2), and H(l), respectively, for the 18 The determination of the interpolation direction for 

degrees, 27 degrees and 45 degrees right descending 55 die binary output (D(- 1), D(0)rD(l)) m the first region 

interpolation lines in FIG. 9. is described next 

These interpolation values are tiien input to the deter- When the values (D(- 1), D(0), D(1))=(0, 0, 0), the 
mination means 9. Which of these seven interpolation pixel level difference exceeds the predetermined refer- 
values should be used is determined by the process ence value kO in each of tiie three mterpolation dhec- 
described below, selected by the selection means 9, and 60 tions vertical, 45 degrees right descending, and 45 de- 
output from the image output terminal. grees left descending, and that there is therefore no 

The pixel data on hnes A and C is input to the sub- significant correlation. The vertical interpolation direc- 

traction means 5A-5G in FIG, S. The subtraction tion H(0) is therefore selected as the interpolation direc- 

means 5A-5G obtam the difference of the pixels on lines tion. In the case (1,1,1), there is a correlation in all three 
A and C to compute the pixel level difference for each 65 directions and H(0) is agam selected because no mean- 

of tiie seven interpolation Imes. Subtraction means 5A, ingful directional relationship can be determined. In the 

5B and 5C obtain the pixel level differences for tiie 18 case (1,0,1). there is a correlation in botii 45 degrees 

degrees, 27 degrees and 45 degrees right descending right and left descendmg directions, indicating a detec- 
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tion error due to the contradiction, and H(0) is again In the cases (0,0»1), (0,1,0), and (1,0,0) a meaningful 

selected as though there is no correlation. In the case directional relationship can be determined and the re- 

(0,1,0) there is a vertical correlation, and H(0) is se- suit of the present evaluation is therefore given prece- 

lected. In the case (0,0,1) the pixel level difference in the dence to select H(- 1), H(-2), or H(-3). 

left descending direction exceeds the reference value 5 While there is no contradiction in the cases (0,1,1) 

kO, and a high correlation can be assumed in the direc- and (1,1,0) and these cases can be handled in the same 

tion H(l) in this region, but because there is the possibil- way as cases (0, 1,0) and (1,0,0), these cases indicate that 

ity that the direction in which interpolation should the direction of correlation is between two of the seven 

actually be applied is at a smaller angle to the left de- interpolation lines. To reduce interpolation errors, these 

scending direction, the final inteipolation direction is 10 cases are assumed to be closer to the vertical, and 

determined with consideration given to (E(l), E(2), H(-l) and H(-2) are therefore selected as with cases 

E(3)) in the second region. (0,0, 1) and (0. 1 ,0). 

Furthermore, there is no contradiction with respect The operation of the circuit shown in FIG. 11 that 

to the correlation for the cases (0,1,1) and (1,1,0) and achieves the above characteristics is described next, 

these cases could be handled in the same way as cases 15 The (D(-l), D(0), D(l)) signal from the absolute 

(0,0,1) and (1,0,0) to improve interpolation perfor- value comparison means 7B is decoded by the binary 

mance, but they are handled in the present embodiment decoder 91, and the (E(l), E(2), E(3)) and (E(-3), 

in the same way as the case (0,1,0) and interpolation E(-2), E(- 1)) signals from the absolute value compar- 

direction H(0) is selected because the interpolation di- ison means 7A and 7C, respectively, are decoded by 

rection is shown to be between vertical and 45 degrees. 20 decoders 92 and 93, respectively. 

Evaluation of the interpolation direction based on the The AND gates 95A-95C apply the evaluation result 

state of the signal (E(l), E(2), E(3)) in the second region returned by the decoder 93 and the OR gates 94D and 

is described next 94E to the selection means 10 only when the binary 

Because the reference value kl used to determine a decoder 91 outputs (1,0,0). AND gates 95D-95F apply 

correlation in the second region is less than kO (kl <k0), 25 the evaluation result returned by the decoder 92 and the 

the value of E(l) will not necessarily be 1 even thou^ OR gates 94B and 94C to the selection means 10 only 

(D(--l), D(0). D(1))=(0, 0, 1). There are thus eight when the binary decoder 91 outputs (0,0,1). When the 

possible combinations as shown in FIG. 10. decoder outputs any other value, the evaluation result 

When the values (E(l), E(2), E(3))=(0, 0, 0) at refer- returned by the decoder 91 and the OR gates 94A is 
ence value kl, there is no significant correlation in any 30 applied to the selection means 10. The output of the 
of the three directions and the previous evaluation re- determination means 9 is applied to the corresponding 
suit H(l) is selected. When (1,0,1), there is a contradic- analog switch lOOA-lOOG in the selection means 10, 
tion in the correlation detection and H(l) is selected as and the interpolation value for the corresponding inter- 
though there is no correlation. polation line is output ft-om the interpolation output 

However, in the case (1,1,1), there is a correlation in 35 termmal. 

dl three directions and no meaningfiil directional rela- For example, when (D(— 1), D(0), D(l)) is (1,0,0), the 

tionship can be determined, but H(2) is selected m con- binary decoder 91 output (1,0,0) becomes active, thus 

junction with the previous determination. making the AND gates 95A, 95B, and 95C active. If 

In tiie cases (0,0,1), (0,1,0), and (1,0,0) a meaningful (E(-3), E(-2), E(- 1)) is (1,1,0) at this time, OR gate 

directional relationship can be determined and the re- 40 94D becomes active, the (E(— 3), E(— 2), E(— 1)) signal 

suit of the present evaluation is therefore given prece- passes through and the analog switch lOOB becomes 

dence to select H(3), H(2), or H(l), active so that the interpolation value H(-2) is output to 

While there is no contradiction in the cases (0,1,1) the image output terminal, 

and (1,1,0) and these cases can be handled in the same To summarize the present embodiment, data for six 

way as cases (0.0,1) and (0,1,0), these cases indicate that 45 pixels in the first region is used to detect the pixel level 

the direction of correlation is between two of the seven difference for interpolation lines in three directions and 

interpolation lines. To reduce interpolation errors, these passing through the pixel to be interpolated. These 

cases are assumed to be closer to the vertical, and H(2) differences are compared with a loose reference value 

and H(l) are therefore selected as with cases (0, 1,0) and kO to obtain a binary data signal, and the best interpola- 

50 tion line among the three interpolation directions is 

Evaluation of the interpolation direction based on the determined using the combinations of binary data for 

state of tile signal (E(-3), E(-2), E(- 1)) in the tiiird tiiese tiu-ee interpolation lines, 

region is described next. Next, if the left descending interpolation direction is 

Because the reference value kl used to determine a selected in the first region, the best interpolation line is 

correlation in the second region is less than kO (kl <kO), 55 determined from among the three interpolation direc- 

the value of E(-l) will not necessarily be 1 even tions using a more restrictive reference value kl for the 

though (D(- 1), D(0), D(l))=(l, 0, 0). There are tiius six pixels in the second region. If the right descending 

eight possible combinations as shown in FIG. 10. interpolation direction is selected in the first region, ±e 

When the values (E(-3), E(-2), E(- 1))=(0, 0, 0) at best mterpolation line is determined from among tiie 

reference value kl, there is no significant correlation in 60 three interpolation directions using a more restrictive 

any of the tiiree directions and the previous evaluation reference value kl for the six pixels in the tixird region, 

result H(- 1) is selected. When (1,0, 1), there is a contra- Linear interpolation is then applied to the one interpola- 

diction m the correlation detection and H(- 1) is se- tion line selected from among die interpolation lines in 

lected as though there is no correlation. seven directions. 

However, in the case (1,1,1), tiiere is a correlation in 65 It is to be noted tiiat tiie above embodiment was 

an three directions and no meaningfiil directional rela- described using seven pixels on tiie above and below 

tionship can be determined, but H(-2) is selected in scan lines and seven interpolation dkections, but five 

conjunction witii tiie previous determination. pixels and five interpolation directions can be easOy 
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used by setting two interpolation directions in the sec- 
ond and third regions and using a two stage evaluation. 

Furthermore, the present invention was described 
with respect to monochrome data, but the same method 
can be applied to color signal interpolation by detecting 
the correlation between the luminance signal or G sig- 
nal (in an RGB dgnal image), and interpolating the 
other signals in the same direction. 

Furthermore, the preferred embodiments were de- 
scribed as a hardware implementation of the method, 
but the same effect can be obtained by applying the 
same steps by means of software routines. 

Effect of the Invention 

The present invention is superior to the conventional 
method of comparing the pixel level differences in each 
direction in the following ways because the correlation 
determining the interpolation direction can be sepa- 
rately determined for each interpolation line and the 
best intexpolation direction determined based on all of 20 
the resulting combinations as described hereinabove. 

It can be definitely determined that there is no corre- 
lation in any direction when the pixel level difference is 
great in all interpolation directions. It is therefore possi- 
ble to prevent correlation detection errors resulting 25 
from this high pixel level difference, and noise and 
image deterioration resulting from the correlation de- 
tection error can be prevented 

Furthermore, when the pixel level difference is low 
in all mterpolation line directions and there is a true 30 
correlation in all directions, it is possible to correctiy 
determine that there is a correlation present in ail direc- 
tions. Correlation detection errors resulting from this 
low pixel level difference can be prevented, and noise 
and image deterioration resulting from the correlation 35 
detection error can be prevented. 

In addition, when there is a correlation between plu- 
ral mterpolation lines and there is a contradiction be- 
tween in the detected correlation, it can be correctiy 
determined that there is no real correlation. Selection of 40 
one of the directions even though it should be deter- 
mined that there is no correlation, and the resulting 
image deterioration, can be prevented. For example, 
when the absolute value of the pixel level difference in 
both the left and right descending directions is less than 45 
that in the vertical direction, and the absolute values of 
the absolute values of the pixel level differences in the 
left and right descending directions are near, there is a 
contradiction in the evaluation of correlation, and the 
present invention can correctly evaluate no correlation 50 
and select the vertical interpolation direction. 

Furthermore, interpolation errors near the vertical 
can be reduced because interpolation directions less 
than 45 degrees to the vertical line can be detected. 



use of six pixels near the pxixel to be interpolated b 
used, and correlation detection is further applied at a 
small angle less than 45 degrees to the horizontal. 
Therefore, high precision interpolation can be applied 
in more directions using fourteen pixels. 

Summarizing these benefits, high resolution interpo- 
lation free of noise and yielding smooth diagonal lines in 
the image is possible. 

The invention being thus described, it will be obvious 
that the same may be varied in many ways. Such varia- 
tions are not to be regarded as a departure from the 
spirit and scope of the invention, and all such modifica- 
tions as would be obvious to one skilled in the art are 
intended to be included within the scope of the follow- 
ing claims. 
What is claimed is: 

1. A correlation detection interpolation apparatus 
comprising a calculation means for setting plural inter- 
polation lines passing through the pixel to be interpo- 
lated at an angle of a maximum ±90 degrees to the 
vertical, obtaining the arithmetic mean of the pixel level 
of the two pixels located above and below the pixel to 
be interpolated on each of the plural interpolation lines, 
and obtainmg the pixel level of the pixel to be interpo- 
lated, 

a correlation value detection means for obtaining a 
pixel level difference of two pixels located on each 
of said plural interpolation lines as a correlation 
value, 

a setting means for outputting a reference value used 
to determine whether the correlation indicated by 
the correlation value output by the correlation 
value detection means exists, 
a comparison means for comparing the magnitude of 
the correlation value output by the correlation 
value detection means with the reference value, 
and outputting a binary signal set showmg the 
presence of a correlation m each direction, . 
a determination means for determining the best of the 
plural interpolation lines using the output set of the 
comparison means, said determination means deter- 
mining whether said binary signal set ou^iut by the 
comparison means indicates a correct interpolation 
du-ection and, if said binary signal set is correct, 
identifying the corresponding interpolation line, 
and if incorrect identifying the vertical interpola- 
tion line, and 

a selection means for selecting and passing the output 
of the calculation means according to the output of 
the determination means. 

2. The correlation detection interpolation apparatus 
according to claim 1 in which the setting means com- 
prises a mean value calculation means for calculating an 

Therefore, diagonal lines in the source image can be 55 arithmetic mean value over all absolute values of the 



smoothed and high resolution interpolation can be ob- 
tained without introducing noise due to correlation 
detection errors into the image. 

In addition to the above benefits of the first embodi- 
ment, the second embodiment of the mvention can ef- 60 
fectively detect more interpolation directions in the 
image regardless of the type of image, and can therefore 
smooth diagonal lines and increase the vertical resolu- 
tion of the image. 

The third embodiment of the invention can further 65 
prevent detection errors at small angles where there is a 
high probability of detection error because correlation 
data with a high degree of reliability resulting from the 



correlation values output by the correlation detection 
means for all the interpolation lines and sets the refer- 
ence value in axxordance with the arithmetic mean 
value calculated by the mean value calculation means. 

3. A correlation detection mterpolation apparatus 
comprising a calculation means for setting plural inter- 
polation lines passing through the pixel to be interpo- 
lated at an angle of a maximum ±90 degrees to the 
vertical, obtaining the arithmetic mean of the pixel level 
of the two pixels located above and below the pixel to 
be interpolated on each of said plural mterpolation lines, 
and obtaining the pixel level of the pixel to be interpo- 
lated. 
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a conelation value detection means for obtaining a 
pixel level di£Perence of two pixels located on each 
of said plural interpolation lines as a correlation 
value, 

a setting means for outputting first and second refer- 
ence values used to determine whether the correla- 
tion indicated by the correlation value output by 
the correlation value detection means reflects a 
high contrast binary image or a low contrast con- 
tinuous image. 

a comparison means for comparing the magnitude of 
the correlation value output by the correlation 
value detection means with the first and second 
reference values, and outputting a binary signal set 
showing results of the comparison, 

a determination means for determining the interpola- 
tion line using the output signal set of the compari- 
son means, said determination means detemuning 
whether said binary signal set output by the com- 
parison means indicates a correct interpolation ^ 
direction and, if said binary signal set is correct, 
identifying the corresponding interpolation line, 
and if incorrect identifying the vertical interpola- 
tion line, and 

a selection means for selecting and passing the output 
of the calculation means according to the output of 
the determination means. 

4. A correlation detection interpolation apparatus 
according to claims 1 or 3 which sets plural interpola- 
tion lines passing through the pixel to be interpolated at 
an angle of a maximum ±90 degrees to the vertical, 

sets a virtual pixel between adjacent pixels within the 
range of at least one pixel on each side of the pixels 
directly above and directly below the pixel to be 3^ 
interpolated^ respectively, and defines the arithme- 
tic mean of the pixel levels of the two adjacent 
pixels as the pixel level of the virtual pixel, and 

increments the angles of the interpolation lines near 
the vertical in smaller steps using the virtual pixel. 40 

5. The correlation detection interpolation apparatus 
according to claim 3 wherein the setting means com- 
prises a mean value calculation means for calculating an 
arithmetic mean value over ail absolute values of the 
correlation values output by the correlation detection 45 
means for all the interpolation lines and sets first and 
second reference values in accordance with the arith- 
metic mean value calculated by the mean value calcula- 
tion means. 

6. A correlation detection interpolation apparatus 50 
according to claims 3 or 5 which sets plural interpola- 
tion lines passing through the pixel to be interpolated at 
an angje of a maximum ±90 degrees to the vertical, 

sets a virtual pixel between adjacent pixels within the 
range of at least one pixel on each side of the pixels 
directly above and directly below the pixel to be 
interpolated, respectively, and defines the arithme- 
tic mean of the pixel levels of the two adjacent 
pixels as the pixel level of the virtual pixel, and 
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grouping the pixel pairs A(-3) and C(3), A(-2) and 
C(2), A(-l) and C(l), A(0) and C(0), A(l) and 
C(-l), A(2) and C(-2). and A(3) and C(-3) on 
the seven interpolation lines passing through pixel 
B(0) into 

a first region of three interpolation lines A(— 1) and 
C(l), A(0) and C(0), A(l) and C(-l), 

a second region of the three interpolation lines A(l) 
and C(- 1). A(2) and C(-2), and A(3) and C(-3), 
and 

a third region of the three interpolation lines A(— 3) 
and C(3). A(-2) and C(2), A(- 1) and C(l), 

and determining the interpolated value of the pixel 
B(0) by applying a step for comparing the differ- 
ence between levels of two pixels located on each 
interpolation line in the first region with a predeter- 
mined reference value to detect whether a correla- 
tion exists, 

a step for similarly detecting the existance of a corre- 
lation in the three interpolation lines of the second 
region when there is a correlation in the left de- 
scending direction (A(l) -tCi— 1)) in the first re- 
gion, by applying a step of comparing the differ- 
ence between levels of two pixels located on each 
interpolation line in the second region with a pre- 
determined reference value, and defining the arith- 
metic mean of the two pixel levels as the value of 
B(0) for the interpolation line about which a corre- 
lation is detected, and defining the arithmetic mean 
of the pixel level in the direction A(l>-^— 1) 1)) 
as the value of B(0) when there is a contradiction 
among conelation results obtained by this step, 

a step for similarly detecting the existence of a corre- 
lation in the three interpolation hues of the third 
region when there is a correlation in the right de- 
scending direction (A(— 1)->C(1)) in the first re- 
gion, by applying a step of comparing the differ- 
ence between levds of two pixels located on each 
interpolation line in the third region with a prede- 
termined reference value, and defining the arithme- 
tic mean of the two pixel levels as the value of B(0) 
for the interpolation line about which a correlation 
is detected, and defining the arithmetic mean of the 
pixel level in the direction A(— 1)->C(1) as the 
value of B(0) when there is a contradiction among 
correlation results obtained by this step, and 

a step for defining the arithmetic mean of the pixel 
level in the direction A(f})-^0) as the value of 
B(0) when any finding other than the above is 
detected in the first region. 

8. The correlation detection interpolation method 
according to claim 7 wherein the reference value used 
in the step for detecting the presence of a correlation in 
the first region is greater in magnitude than the refer- 
ence value used in the steps for detecting the presence 
of a correlation in the second and third regions. 

9. The correlation detection interpolation method 
according to claim 7 wherein the reference value is 
varied in accordance with an arithmetic mean value 



increments tiie angles of the interpolation lines near 60 calculated over all correlation values obtained for all 



the vertical in smaller steps using the virtual pixel. 
7. A correlation detection interpolation method for 
interpolating a pixel defined as B(0) using the seven 
pixels A(-3), A(-2), A(-l), A(0), A(+l), A(-h2), 
A(4-3) above and the seven pixels C(-3), C(-2), 63 
C(- 1), C(0), C(-h 1), C(+2), C(-h3) below where A(0) 
and C(0) are the pixels directiy above and directiy 
below pixel B(0), respectively, by 



interpolation lines. 

10. A correlation detection interpolation apparatus 
which defines the pixel to be interpolated as B(0), uses 
the seven pixels A(-3), A(-2), A(-l), A(0), A(+l), 
A(4-2), A(-h3) above and the seven pixels C(-3), 
C(-2). C(-l), C(0), C(+l), C(.h2), C(-|-3) below 
where A(0) and C{0) are the pixels directiy above and 
directiy below pixel B(0), respectively, 
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means for grouping the pixel pairs A(— 3) and CX3), 

A(-2) and C(2). A(-l) and C(l), A(0) and C(0). 

A(l) and C(-l), A(2) and C(-2), and A(3) and 

C(— 3) on the seven interpolation lines passing 

through pixerB(0) into 
a first region of the three interpolation lines A(— 1) 

and C(l), A(0) and C(0). A(l) and C(-l), 
a second region of the three interpolation lines A(l) 

and C(- 1), A(2) and C(-2), and A(3) and C(-3), 

and 

a third region of the three interpolation lines A(— 3) 
and C(3), A(-2) and C(2), A{- 1) and C(l), 

and determines the interpoktion value of the pixel 
B(0) by means of a calciilation means for obtaining 
the arithmetic mean of levels of two pixels located 
on each of the seven different interpolation lines to 
obtain the possible pixel levels of the pixel to be 
interpolated B(0), 

a correlation value detection means for obtaining a 
difference between levels of two pixek located on 20 
each of the seven interpolation lines and detecting 
a correlation value, 

a setting means for outputting a reference value used 
to determine whether the correlation indicated by 
the correlation value output by the correlation 25 
value detection means exists, 

a comparison means for comparing the magnitude of 
each of the correlation values for the seven interpo- 
lation lines output by the correlation value detec- 
tion means with the reference value set by the 30 
setting means to determine whether or not a corre- 
lation exists in each of seven interpolation direc- 
tions indicated by the seven interpolation lines and 
for ou^utting a first to third set of binary signals 
representative of the first and third regions, respec- 
tively, indicating results of the determination for 
three interpolation directions in each of the first to 
third regions, respectively, 

a determination means for determining an iaterpola- 



35 



by the comparison means indicates a correct inter- 
polation direction and, if said binary signal set is 
correct, identifying the corresponding interpola- 
tion line, and if incorrect identifying the vertical 
interpolation line, and 
a selection means coimected to the output of the 
calc\ilation means for passing the arithmetic mean 
of levels of two pixels located in the interpolation 
direction determined by the determination means, 
and the determination means includes a first, a 
second and a third decoding circuit for decoding 
the first, second and third set of binary signals 
output by the comparison means and determines 
the interpolation direction based on the output of 
the second decoding circuit when the output of the 
first decoding circuit indicates the presence of a 
correlation in a direction indicated by 
A(l)-^(— 1) interpolation line, the output of the 
third decoding circuit when the output of the first 
decoding circuit indicates the presence of a corre- 
lation in a direction indicated by A(-1)-»<:(1) 
interpolation line, and the output of the first decod- 
ing circuit when neither the A(l)-»<;(— 1) or 
A(— 1>-^1) interpolation lines are outputted by 
the first decoding circuit 

11. The correlation detection interpolation apparatus 
according to daim 10 wherein the setting means outputs 
first and second reference values which reflect a high 
contrast binary image or a low contrast continuous 
image, respectively, and the comparison means com- 
pares each of the correlation values obtained in the first 
region with the second reference value and each of the 
correlation values obtained in the second and third 
regions with the first reference value. 

12. The correlation detection interpolation apparatus 
according to claim 10 in which the setting means com- 
prises a mean value calculation means for calculating an 
arithmetic mean value over all absolute values of the 



tion direction in which a correlation operation is to 40 correlation values for each interpolation line output by 
be performed among the seven interpolation direc- the correlation detection means and sets the reference 



tions based on the set of binary signals output by 
the comparison means, said determination means 
determining whether said binary signal set output 



value in accordance with the arithmetic mean value 
calculated by the mean value calculation means. 
« * ♦ * « 
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